An Alternative Method for Estimating and Simulating Maximum Entropy Densities
نویسندگان
چکیده
This paper proposes a method of estimating and simulating a maximum entropy distribution given moment conditions based on MonteCarlo approach. The method provides an simple alternative to conventional calculation methods of maximum entropy densities which involve complex numerical integration and are subject to occasional failure. We first show that maximum entropy density on a random sample converges to minimum cross entropy solution to the sample density. Using this result, we show that the empirical maximum entropy density on a uniform sample supported within sufficiently large boundary converges to the true maximum entropy density. The performance of the proposed method is checked by several examples.
منابع مشابه
A Nested Test for Common Yield Distributions with Application to U.S. Corn
We propose the use of maximum-entropy techniques to nest and test the functional form of commonly used yield densities. We demonstrate how common parametric yield models can be nested within a maximum-entropy framework and subsequently tested for using standard hypothesis tests. We include an empirical application that tests the beta distribution against a more general maximum-entropy alternati...
متن کاملPartially Adaptive Estimation via the Maximum Entropy Densities∗
We propose a partially adaptive estimator based on information theoretic maximum entropy estimates of the error distribution. The maximum entropy (maxent) densities have simple yet flexible functional forms to nest most of the mathematical distributions. Unlike the nonparametric fully adaptive estimators, our parametric estimators do not involve choosing a bandwidth or trimming, and only requir...
متن کاملUnification of Field Theory and Maximum Entropy Methods for Learning Probability Densities
The need to estimate smooth probability distributions (a.k.a. probability densities) from finite sampled data is ubiquitous in science. Many approaches to this problem have been described, but none is yet regarded as providing a definitive solution. Maximum entropy estimation and Bayesian field theory are two such approaches. Both have origins in statistical physics, but the relationship betwee...
متن کاملAn Eecient Algorithm to Compute Maximum Entropy Densities
| We describe an algorithm to eeciently compute maximum entropy densities, i.e. densities maximizing the Shannon entropy ? R p(x) log p(x)dx under a set of constraints Eg i (x)] = c i , i = 1;: : : ; n: Our method is based on an algorithm by Zellner and Highheld, which has been found not to converge under a variety of circumstances. To demonstrate that our method overcomes these diiculties, we ...
متن کاملA Maximum Entropy Approach to Loss Distribution Analysis
In this paper we propose an approach to the estimation and simulation of loss distributions based on Maximum Entropy (ME), a non-parametric technique that maximizes the Shannon entropy of the data under moment constraints. Special cases of the ME density correspond to standard distributions; therefore, this methodology is very general as it nests most classical parametric approaches. Sampling t...
متن کامل